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ABSTRACT 


iiemeugiedtictilon cate an Naval Flight Officer (NFO) 
training has been the subject of much concern and attention 
meoresome time, Of particular concern is the exceedingly high 
Meeeriton rate in Radar Intercept Officer (RIO) training. 
The present prediction system is based on a linear regression 
technique of academic and flight variables. This thesis 
attempts to improve on the current prediction methods by up- 
dating the variables used, adding variables based on students 
personality traits and exploring the possibility of employing 


Bem Logistz¢ function as the prediction technique. 
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fol eRODUeCTEON 


The cost of fully training a Naval Aviator or Naval 
Flight Officer (NFO) to assume his operational role in the 
fleet represents a large investment of the Navy's time and 
money. The Navy could receive the optimal return from this 
investment if it could select and train only the number of 
people that are required to meet fleet operational require- 
ments. Ideally this means everyone selected for training 
eventually becomes a designated Naval Aviator of NFO. Zero 
meeriti1On 1S, Of course, impossible to attain in a training 
mmeqram Of this Size. Efforts to reduce attrition are gen- 
erally cost-effective. Since the student input to the 
aviation training program is so large a small decrease in 
the attrition rate reflects a large savings to the Navy. 

PeSeleeciemcan attrite from a Eraining program for any 
of several reasons, and it is generally agreed that there 
iS no one simple causitive factor--nor, for that matter, a 
quick and easy solution. Some of the primary reasons for 
Student attritions are: 

1) Voluntary withdrawal or drop on request (DOR). 
Students DOR for a number of reasons many of which 
em terre tt, ©. predict. 

2) Not physically qualified (NPQ). Due to the strin- 
gent physical requirements hROmuEomeGy siatoO: tne train= 
ing program this is a small percentage of total 


ait tess 





Pee transcrer Eee another training program (NFO to pilot 
Or pilot to NFO). Again this is a small percentage 
Smeencmeora ll. attri tion. 

4) Academic failure. Unsatisfactory performance in 
academic work. 

pyeehlight ferlunre. Unsatisfactory inflight performance. 

6) Practical work failure. Unsatisfactory performance 


Peematouna Simulatzer or training device. 


Since some attrition 1S inevitable in a large training 
program it seem logical and cost-effective to reduce the 
attrition by selecting and training only those students that 
Mave a good chance of successfully completing the program. 
This then becomes a problem of predicting success or per- 
formance on a wob. Good prediction is essential to the 
Navy since ultimately operational readiness and national 
defense depends on it. The use of periodic prediction dur- 
ing the course of a training program also provides important 
information to training specialists for effective guidance 
and counseling of the student as he progresses. 

The business of prediction 1S a popular one. There are 
numerous studies and cases in the literature dealing with 
prediction of success or prediction of performance. Basi- 
cally, they fall into the two categories of predicting aca- 
demic success or predicting job success. As early as 1947, 
Eysenck estimated there were more than a thousand studies 
recorded in educational literature pertaining to academic 
prediction. Although the number of studies abound they 


£ 





mmeely Giffer in procedures. Stein (1963) stated that 
memotes atiter £Lrom Geach Other in criteria, procedures, the 
types of students, and the method in which the data were 
reported. 

These studies revealed different types of factors being 
examined for their use as predictors. The most common of 
these are intellective factors, prior scholastic performance 
and sociological factors. Intellective factors are measured 
by aptitude or intelligence tests such as the Graduate Record 
PmediniNnation. Prior scholastic performance in the form of 
academic grades is considered by many to be the best predic- 
tor of academic success. Research into sociological factors 
indicates they have some effect on academic success but it 
is extremely difficult to determine the extent (Wilson, 1969). 

More recently there has been an increased interest in 
the relationship of job performance and the personal char- 
acteristics that predict it. There have been many signifi- 
cant developments in the area of performance research by 
both industry and the military. As early as 1950 Mandell 
produced significant results in predicting job success of 
engineers. His predictors were constructed from five dif- 
ferent tests covering physics, mathematics, evaluation of 
hypothesis, visualization and reading. 

It has long been thought that personality factors con- 
tribute highly to job performance. Cattell emphasized the 
importance of personality-ability traits in prediction of 


job performance in 1957. As Sechrest (1968) points out, 





PerocemalltyverestS are Of interest to the extent that they 
are indicative in some manner of the way in which the indi- 
vidual will respond in an inferential chain which leads to 
some manner of behavior or performance. Although person- 
ality traits are generally acknowledged to be important to 
human performance, efforts to use them as predictors of job 
performance have met with little success. After analyzing 
various tests used for predicting success on the job, 
Smesella and Barthol in 1953 and Guion and Gottier in 1965 
concluded there is no generalized evidence that personality 
measures can be recommended as good or practical tools for 
employee selection. The most that was said for them is that 
they are helpful only if it 1s specifically and competently 
determined for a specific situation and for a specific cri- 
terion within that situation. Kelly (1967) and Buch and 
Haggard (1968) emphasized the need for complex multivariate 
design and analysis to properly interpret the results of 
personality tests and to determine how and to what extent 
the predictor variables explain or predict the response as 
measured by the dependent variable or criterion. 
Ticmiiiiiany has been quite active in conducting research 
On predicting job performance. Numerous studies conducted 
by the United States Air Force (Tupes, 1959; Lichenstein and 
mains lI62; Tupes, Carp and Borg, 1957; Tupes, 1963; Judy, 
1962) have attempted to predict job performance from Officer 
Effectiveness Reports (OER). These studies have addressed 
various aspects of job performance resulting in varying 


degrees of success in prediction of performance. 
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The United States Navy has done considerable research 
on predicting success in the Naval Aviation Training Program. 
Since 1963, the Aerospace Psychology Division of the Naval 
Aerospace Medical Institute has provided information to 
naval training adminstrators on predicting success in avia- 
tion training (Shoenberger, Wherry and Berkshire, 1963). 
Upon request, administrators are given the computed proba- 
bility based on multivariate techniques of a specific stu- 
meme rsuccesstully completing the flight program. These 
probabilities are obtained by appropriately weighing past 
performance measures such as initial selection test scores, 
academic course grades and flight grades. Knowledge of 
such probabilities has improved the accuracy of decisions 
regarding the indentification of marginal student pilots. 
Such data could be used to increase the efficiency of uti- 
mezation Of pilot training facilities and personnel. 

In the early and mid 1960's advent of multi-crew air- 
craft such as the P-3, F-4, A-5, A-6 and E-2 emphasized the 
need for an improved training program for the Naval Flight 
Officer in order to provide the skilled personnel to operate 
m@niese new highly complex and diverse aircraft. Along with 
the expansion of the NFO training program came a need for a 
meeeaitcetion system to reduce attrition in this rapidly ex- 
panding program and thereby increase the efficiency of uti- 
lization of the available training assets. A prediction 
oLtemesimidar to the one in existence for pilot training 
was developed for the Naval Flight Officer (Peterson, Booth, 


Lane and Ambler, 1967). 
11 





Technological development in naval aviation continued 
momgenerate more intensive specialization in NFO training 
and increased the number of advanced training specialties 
open to the student Naval Flight Officer. Presently there 
are five specialties or advanced pipelines available to the 
fee Figure 1, taken from the Chief of Naval Air Training 
Miecruction 1.500.4 of March, 1975 is a diagram of student 
NFO flow from the initial stages of training to the various 
advanced pipelines. All student NFO's receive a common 
SeGe Of training up through the NFO basic training squadron, 
Pile. ft 1S here in VT-10 that the student states his 
preferences as to which advanced pipeline he would prefer 
to enter. The student is given his choice whenever possible, 
but needs of the service and availability are the ultimate 
criteria for assignment. 

The student NOS's selection of an advanced pipeline is 
Pmem@tecrcal point in his training. With approximately six 
months of training completed it is believed that those stu- 
dents who are destined to attrite would have done so by this 
Stage of training. If this were true then the more advanced 
and expensive training would be relatively free of attrition. 
However, this is not the case. Attrition in the advanced 
Pipelines continue to take a costly toll. Statistics held 
by the Office of the Chief of Naval Education and Training 
Show an attrition rate of about ten percent for the student 
NFO after he leaves baSic training. For the RIO program 


alone the figure is about twenty-five percent. 
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Diagram of SNFO Flow 
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A methodology was developed by the Aerospace Psychology 
Division of the Naval Aerospace Medical Research Laboratory 
to assist in the problem of asSigning trainees to one among 
@everal Specialities (Ambler, Rickus and Booth, 1970). tThis 
is a personnel decision method that alters the traditional 
Sencept of “assignment” to the concept of “prevention of 
misassignment." Multiple regression analysis iS applied to 
the quantitative variables from initial screening and basic 
training for a sample of students from each type of advanced 
Mmeaining. The dichotomous criteria of pass versus fail is 
used to develop prediction equations for each pipeline. 
These equations were then incorporated into a system that 
permits immediate feedback information to personnel and 
training officers regarding whether a particular student 
under consideration for assignment to an advanced pipeline 
would have a high or low probability of completing the ad- 
vanced training. 

Pieneugdi enese GLEOrESs at prediction in the NFO program 
met with some success it did not enjoy the same degree of 
Success aS waS gained with the pilot prediction system. Of 
Pare icular concern to the training administrators was the 
exceedingly high attrition rate of the Radar Intercept Offi- 
cer (RIO) student, those training to fly in the rear cockpit 
Gt the F-4 aircraft. Ambler, Rickus and Booth (1970) en- 
countered a RIO attrition rate of thirty-five percent for the 


Sample studied. 
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Although the present prediction system contains only 
variables from the selection test scores and academic and 
flight grades there has been an ongoing effort to find other 
types of variables for inclusion in the selection and predic- 
tion procedure. In particular, there has been several ef- 
forts to include personality traits in the prediction equa- 
tions. The military had enjoyed considerable success com- 
pared with the civilian world in the use of personality in- 
ventories for selection and screening tools to predict the 
problem of adjustment to military life (Ellis and Conrad, 
mas). in addition, there was an expectation based on logic 
that personality is related to success in flight training, 
however, efforts to relate personality measurements to this 
criteria have been mostly unsuccessful. Past research re- 
veals attempts to use different personality instruments as 
they are created in the literature in hopes of finding one 
useful as a prediction device. Schoenberger (1963) used 
the Bass SIT inventory to obtain a correlation between per- 
sonality orientation and success in aviation training. He 
concluded that there was very little relationship between 
the two. In 1965 the Edwards Personal Preference Schedule 
(EPPS) was evaluated as a predictor of success in naval 
flight training (Peterson, Lane and Kennedy, 1965). The 
EPPS failed to discriminate between those who successfully 
completed training and those who failed. In 1966 a study 
investigated five different personality scales for possible 


use as predictors (Fleischman, Ambler, Peterson and Lane, 


1S 





1966). The five scales were: (a) Cattell's Sixteen Person- 
mmrey QOUeStionnaire, (b) the Taylor Manifest Anxiety Scale, 
(c) the Alternate Manifest Anxiety Scale, (d) the Pensacola 
Z Scale, and (e) the Adjective Check-List. The results were 
considered promising but no attempt was made to cross-vali- 
Meee the results and no further attempts were made to develop 
these scales as predictors. Another study attempted to uti- 
lize the Objectively Scoreable Apperception Test (OAT) as a 
selection and prediction device (Beal and Waldeisen, 1969). 
It was concluded that the OAT as it currently existed was 
Mot suitable for inclusion aS a primary predictor. 

The primary reasons for student attrition were listed 
earlier in this paper. Most attrition is caused by either 
voluntary withdrawals (DOR) or failures in academic or 
Flight/practical work performance. Most of the DOR's occur 
because of dissatisfaction with the system or training pro- 
gram. This dissatisfaction could arise during training as 
@ result of changes in syllabi, disruptions in the training 
Flow or objection with advanced pipeline selection. The 
root of the student's dissatisfaction could also have started 
Prior to training in the recruiting area. Perhaps the stu- 
dent was seeking entrance to pilot training but physical 
problems resulted in his taking NFO training as a trial al- 
ternative. Or perhaps the recruit was not fully appraised 
of the nature of the training and the career for which he 


was applying. 
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Because there are potentially many diverse reasons and 


Circumstances that may contribute to a student's decision 


to withdraw voluntarily from the program it is reasonable 


memexpect that the DOR type attrition would be difficult to 


meeedict. 


A more fruitful area for reducing attrition seems 


moe be in prediction of those who will attrite through aca- 


meme or £Llight/practical work failure. To this end the 


purpose of this thesis was to investigate ways to improve 


the method of predicting success by: 


=) 


Z) 


3) 


Updating the existing prediction equations now being 
used. Using the present methodology of linear re- 
Geecctemeche Most Curbrenc academic and flight data 
was used in hopes of improving predictability. 
Including another personality measurement device to 
investigate the possibility of increasing the cor- 
relation of success or failure with personality 
traits. 

Apply a different mathematical model for deriving 


the predictor equations. 


This paper will deal only with the RIO pipeline since it 


is the area of highest attrition. However, the analysis 


technigues could be applied to any of the advanced pipeline 


SECas. 


Mey 





ee LOD 


For the first two purposes of this paper, updating the 
existing prediction method and incorporating personality 
variables, a multiple linear regression analysis was used. 
The BIOMED series 02R stepwise regression routine (University 
Of California, 1973) executed on a IBM 360/67 computer was 
melized fOr the computation. For the third purpose of 
trying a different model for analysis a logistic transforma- 
tion was applied as opposed to a linear transformation. A 
comparison of the two transformation techniques will be fur- 


moer discussed in a later section of this paper. 


A. DATA 

The academic variables entered for analysis were derived 
meom three different areas; selection tests, Environmental 
Miaectrination and Basic Training (VT-10). The twenty vari- 
ables derived and their sources are listed in Table I. The 
mrgnt and practical work scores were obtained from the VT-10 
flight syllabus and the 1D23 simulator syllabus to make a 
metal Of twenty-two academic and flight variables. The per- 
sonality variables were obtained from scores on the Omnibus 
Personality Inventory (OPI) (Heist and Yonge). The OPI was 
developed for the purpose of providing a meaningful, differ- 
entiation description of students and a means of assessing 
change rather than a device or instrument for testing a 
Specific theory of personality. The fourteen scales that 


Mane up the OPI are listed in Table II. 
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TABLE Ff 
PooeeOmeaACADEMIC AND FLIGHT VARIABLES 


SELECTION TESTS 


Tere loneOlalbitieatien Test (AQT) 
Mechanical Compreshension Test (MCT) 
Blegraviical Inventory (BIL) 

Spatial Apperception Test (SAT) 
Flight Aptitude Rating (FAR) 


ENVIRONMENTAL INDOCTRINATION 


Aerodynamics (AERO) 
Engineering (ENG) 


Bao sv r= 10) 


Visual Navigation (VN) 

Dead Reckoning (DR) 

Flight Rules and Regulations (FRR) 
Airways Navigation (AN) 
instoument Ground School (IGS) 
Basic Meteorology (BMT) 

Advanced Meteorology (AMT) 
Plici@emosuoeort (FS } 

BleGraroctry ana Electronics (EE) 
Radar Systems (RS) 

Computer Systems (CS) 

Electronic Warfare (EW) 

Advanced Systems (AS) 


FLIGHT/SIMULATOR 


VT-10 Flight Sylabus Grade (FLT) 
VT-10 1D23 Simulator Grade (TRAN) 
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TABLE II 


Ser itowon ThE OMNIBUS PERSONALITY INVENTORY 


Miromicing sIneLroversiOn err. ) 
MieOreercal Orientation. (TO) 
Estheticism (Es) 

Complexuey (Co) 

Autonomy (Au) 

Religious Orientation (RO) 
SOCHaleExXeheversion (Sh) 
Impulse Expression (IE) 
Personal Integration (PI) 
Anxiety Level (AL) 

Altruism (Am) 

Bederrcadl OuUELOOK (PO) 
Masculinity~Femininity (MF) 
Response Bias (RB) 
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fee SUBJECTS 

Pe7cemuecuanawrlight data on 160 students was used for 
the analysis. These students were Navy or Marine officers 
Mmeethe Naval Flight Officer Training Program who completed 
VT-10 and started Radar Intercept Training at VT-86. The 
group consisted of those RIO selectees Starting from VT-10 
Siass 437 graduating from basic in May, 1974, through the 
mecember, 1975, VT-86 RIO graduating class. Twenty-eight 
of these 160 students attrited in the RIO phase for academic/ 
Mmierght failure, a failure rate of 17.5 percent. 

OPI data was available on only 93 of the original 160 
Subjects. Therefore, analysis involving use of the person- 
ality variables was restricted to these 93 subjects. The 
OPI test was administered to the subjects early in training 
by the staff of the United States Medical Research Labora- 


jfery, Naval Air Station, Pensacola, Florida. 


ic. PROCEDURE 

The criterion used here was completion of RIO training 
Mersus attrition by reason of academic or flight/practical 
work failure. A zero was assigned as the dependent variable 
if the student attrited and a one was assigned if the stu- 
dent completed the program. For this study voluntary with- 
drawals or DOR's were eliminated in arriving at the final 
sample of 160 students. First the group as a whole was 
analyzed to determine the highest multiple correlation with 
the criterion. Then the subjects were randomly divided into 


moe groups. Two-thirds of the initial group, 108 subjects 


zal 


were again analyzed in the same manner as the original 160 
to obtain predictor variables, their weights and a multiple 
R. The second group of 52 subjects was used to cross-vali- 
Mace the results obtained from the first group. The weights 
computed from the first group were applied to the variables 
from the second group to obtain predicted values of the 
criterion. These predicted values were then compared to the 
actual dependent variable to calculate a correlation between 
the actual and predicted. 

The linear regression analysis was done first using only 
the twenty two academic and flight variables (the existing 
method of determining predictor scores). Then the regres- 
Sion analysis was done for the OPI sample using only the 
fourteen personality variables. Using the results of the 
OPI analysis, the three most heavily weighted personality 
variables were then added to the twenty-two academic and 
flight variables for similar analysis. 

After the analysis was completed on the total group, 
the academic and flight variable regression analysis was 
then applied to the Navy and Marine students as separate 
groups. This was attempted to investigate the possibility 
that the predictor equations and results are significantly 
different when applied to the total group as opposed to 
separate Navy and Marine groups. The existing prediction 
system treats all the students as one group. 

For the logistic transformation analysis the computation 


was performed utilizing only the academic and flight variables. 
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M7 this way the logistic technique can be compared directly 


with results obtained by the presently used linear model. 
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itt. ANALYSIS AND RESULTS 


This section contains a discussion of the analysis tech- 
niques used and the results obtained from the analysis. The 
meonmethods of computation - linear regression and logistic 


transformation will be discussed separately. 


A. LINEAR REGRESSION MODEL 


The linear regression model is of the form: 
Yo=— BAot Ce 


where, Y is a vector of dependent variables, pass/fail 
(AZO) 
Bessa veCton Of COecificients, or Beta weights 
X 1s the matrix of independent variables, 
academic/flight or OPI scores 


SP ae slow Sicicieig eaiein 


In performing the regression analysis certain assumptions 
are made about the errors; the errors are independent, have 
zero mean, constant variance and are normally distributed 
(Draper and Smith, 1966). After running the regression rou- 
tine with the academic and flight variables a plot of the 
residuals against the criterion and against the independent 
variables revealed an error in analysis. The plot indicated 
that the assumptions had been violated and that the linear 
model may not be the proper model to use. This arises from 


miemwract that the dichotomous criteria of pass/fail is 
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Meevally a series of Bernoulli trails resulting in a bino- 
mial variable not a normal ee teetownOn this reason the 
logistic transformation was selected as an alternative meth- 
od of analysis. Advantages of the logistic method will be 
discussed later in this section. Another problem arising 
when linear regression is used on a dichotomous criteria is 
that the predicted values from the regression equation are 
Zen timited to falling within the unit interval. It is 
possible to get predictor scores that are less than zero or 
greater than one. For this reason the predictor scores are 
not directly interpretable as probabilities of success or 
failure. The sole advantage of using the linear regression 
technique is it requires relatively simple calculations to 
arrive at the beta weights. 

The means and standard deviations of the academic and 
flight variables for the 160 students are shown in Table 
mer. Table IV is the intercorrelation matrix including all 
the academic/flight predictor variables and the pass/fail 
criterion. When all academic/flight variables were used in 
the stepwise regression, eight were significant at the .05 
level. However, the contribution of the last three variables 
selected at this level was not considered sufficient to war- 
mifiecneir inclusion in the predictor score formula. Thus, 
the weights to be applied to the first five variables chosen 
were computed. The five variables chosen and their multiple 
R are listed in Table V. As mentioned earlier, cross-vali- 


dation was accomplished by dividing the sample randomly and 
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TABLE III 


MEANS AND STANDARD DEVIATIONS 
OF ACADEMIC AND FLIGHT VARIABLES 


Variable Mean Std. Dev. 
Pass/Fail OZ Oe Sits 
Ou ono 51 
FAR ay Al 2.21 
MCT O34 B36 
SAT de ee, SU As 
BI IG UL 8296 
ENG Ao ol Sie 
AERO 50.96 Oe. 
VN Bledel 970 
DR BiG) ALE 8.08 
FRR 49.91 Oro 7 
AN Sle Sl 9.07 
IGS on res 4! 9.08 
EE BAS OF 0iG 
RS Smal 8.43 
eS S136 9.25 
EW 50.29 o 0c 
AS BS) 5 od 8.49 
BMT ol ea oie), 9.43 
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ACADEMIC AND FLIGHT VARIABLES AND THE 
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TABLE V 


FIVE MOST SIGNIFICANT ACADEMIC/FLIGHT 
VARIABLES FROM LINEAR MODEL 


Variables Cumulative Multiple R- 
Simulator (TRAN) 396 
Dead Reckoning Nav (DR) easy 
Meetricity & Electronics (EE) moe 
Visual Navigation (VN) ~501 
Aerodynamics (AERO) eye 


* 
All variables significant at .05 level 


28 





applying the stepwise regression method to each sample. 
Cross-~validation resulted in essentially the same variable 
weights and multiple correlation coefficients for the sub- 
sample. A correlation coefficient of .52 was computed on 
the cross~validation sub-sample. 


The personality variables were then entered in the step- 


wise regression routine. Table VI shows the means and stanc- 
ard deviations of the fourteen personality variables. Table 
Meiers the intercorrelation matrix of OPI variables. Only 


three of the OPI variables were significant at the .05 level. 
The OPI variables and their multiple R are listed in Table 
VIII. The three OPI variables were then added to the twenty- 
two academic/flight variables and all were entered into the 
regression routine. Eight variables were significant at the 
.05 level, two of the eight were personality variables. 

Table IX lists these eight variables with their multiple R. 
Although all eight variables appeared to increase the multi- 
ple R enough to be included in the predictor equation, for 
Simplicity and consistency with before only the first five 
were used for cross-validation purposes. Table X shows the 
results when the academic/flight variables by themselves and 
the OPI variables by themselves were applied to the Navy and 
Marines as separate groups. Table XI presents a summary of 
the multiple R and the correlations obtained in the different 


analysis. 


meee HOGISTIC MODEL 


The logistic model (Solberg, Brown and Rutemiller, 1975) 


2¢ 





TABLE VI 


MEANS AND STANDARD DEVIATIONS 
OFPSOCPT VARIABLES 


Var raoles 


ienking Introversion (TTI) 


Mmimeoretical Orientation (TO) 


Estheticism (Es) 
Complexity (Co) 

Autonomy (Au) 

Religious Orientation (RO) 
Social Extroversion (SE) 
Impulse Expression (IE) 
Personal Integration (PTI) 
Anxiety Level (AL) 
Altruism (Am) 

Meactical Outlook (PO) 
Masculinity-Femininity (MF) 
Response Bias (RB) 


30 


Dev. 


JWOD ~300 OO O30 DOO © 
_ 
CO 


e 
Sa) 
oe) 


to Wm 
in \O 
CO © 





Cae 


SOm. 0 | 

Clee Or OL 

Cie S205 0. L 

Vibe? €C =f =O 

One 6c bbe Te 30 bE 

Oma coe LY amcoe UG TL 7Or of 

Gaim SVC S60 “VC =heo ee ye Ur Tf 
Was yee OL =90° 99% vO ee Var 0 
Ome ian oO” 605-60 SO] eh = Le : 
Gite OF = 70 SUS OL 90 cL 
vile Ol (CO eS SO TU LE sac 
CURRY eanrGo” —OLeacce FO Sek oie 
Gee eee OC sO fe Ve OU: 
CeO U Stew mege aie OL Mee 7] 
quad dW Od Ww IW Id dI as 


NOITYdLIYO AHL GNY Sdldvilyuwa 


Ca 

oy Bee OAL 
ae ee erp 
CO =S0R ao 
Be OMS 
CC mo Sea 
SCs Uamay C * 
OH UW OO 


Oi 
1 
6c ° 
Haye 


Sal 


IdO HO XIYLVW NOLTLVISddOoOuaLNE 
ITA ATA 


O°T 
oh 
es 


OL 


du 
AN 
Od 
WY 
TW 
Id 
al 
dS 
Ow 
AW 
ore) 
Sa 
Ob 
IL 


O°T d/d 





31 





TABLE ey fit 


CMI BUSa PERSONALITY INVENTORY VARIABLES 
AND MULTIPLE R FROM LINEAR MODEL 


Variable Cumulative Multiple R 
* 
ala -194, 
Am OS. 
MF ~ 343 
Es Seo). 
Sis = BA Sys: 
ils Boo 
PO per ee 
in @ 2G 
alt eS, 
RB oo) 
Au Or) 
AL eose 
RO 89 
Co OO 


* 
Ssmonificant at .05 level 
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Gn MOS ti SIGNI TCANT VARIABLES 
OPI, ACAD/FLIGHT AND MULTIPLE R 


Variable Cumulutive Multiple R 
EE 5 Nae! 
cia ~524 
TRAN SY 
MF O09 
EW 2615 
AQT 630 
FAR -648 
BI ao 


* 
All variables significant at .05 level 


333 





TABLE xX 


SUMMARY TABLE 


NAVY AND MARINE AS SEPARATE GROUPS 


Group 


Navy Acad/Flt 


Navy OPI 


Marines Acad/Flt 


Marines OPI 


No. 


Se 


ne Sibloyexeres 


89 


28 


qa 


65 


34 


Canine 


Mii. 


.624 


aay Oy 


ee 


-448 





moca 1 
meaa/Fit 


Navy 
Pead/F1t 


Marines 
meada/i1t 


metal OPI 
Navy OPI 
Marine OPI 


Total 
Acad/F1t/oOPI 


meoss Validation 
mead/Fit/OPI 


Cross Validation 
Acad/Fit 


@eoss Validation 


Acad/F1lt Logistic 


Method 


TABLE XI 
SUMMARY TABLE OF MULTIPLE R 


NG. OF 
Subjects 


160 


89 
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2) 8: 
28 


66 
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mo Of the form: 


y= — Exp (BX) 
iP exo (Bx) 


where Y, B and X are the same as in the linear model. The 
beta weights or coefficients are obtained by maximum likli- 
mea estimation (MLE). Professor Gerald Brown of the Naval 
Postgraduate School has written a computer routine that com- 
putes the beta weights for the logistic model in a manner 
Similar to the stepwise multiple linear regression routine. 
Variables are entered or removed from the predictor equations 
depending on the significance of their contribution to the 
dependent variable. The primary advantage of this model is 
that the dependent variable is bounded by zero and one and 
thus can be directly interpreted as a probability of success 
Peetiallure. A Chi-Square goodness of fit test is utilized 
to determine the significance of the predictors with the 
Mass/fail criterion. The logistic routine resulted in the 
same five variables weighting the heaviest as was true for 
the linear analysis. Cross-validation was accomplished on 
the same subset of 52 subjects as the linear model. The 
correlation coefficient obtained on cross-validation was 
.68. Table XII presents a summary of the regression coef- 
ficients obtained by the two different analyses on the dif- 


ferent subsets of data. 
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Pee flte 
Logistic Model 
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IV. CONCLUSIONS AND RECOMMENDATIONS 


The variables chosen by the two analysis techniques 
(when applied to the total group) appear to have face valid- 
ity based on logic. It seems logical that scores received 
on a Simulator and in a navigation course are predictive of 
future performance in an advanced program heavily loaded 
with cockpit time requiring skills acquired from basic navi- 
gation. It is encouraging to see the same five variables 
weighted the heaviest in both the linear and the logistic 
analysis. A discouraging result, however, is the poor con- 
tribution of the selection test variables. Although they 
may be of some use in the early stages of training they 
appear to have little predictive validity at the advanced 
stage. One interesting result of the analysis is the sig- 
nificant increase in the multiple R obtained when the Navy 
and Marine students are treated separately instead of as 
one group. No attempt will be made here to explain this 
result but further study with the two separate groups 1s 
needed to see if the results obtained here are a statistical 
artifact or if the results are in general valid with other 
Navy and Marine groups. It is encouraging, however, that 
the two groups do have two common predictors—dead reckoning 
navigation and simulator grade. 

ieesaecultsevootainea after inclusion of the personality 


variables are particularly encouraging. Their contribution 
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to the multiple R is greater than has been experienced in 
past studies. The fact that two of the five most heavily 
weighted variables are personality traits could be an indi- 
cation of the importance of personality factors in perform- 
ance. Perhaps the Omnibus Personality Inventory is the 
long sought after measure of personality that will lead to 
some improved prediction ability. 

Encouraging as some of these results might be, it must 
be remembered that this analysis was performed under the 
handicap of a small sample size. More work is needed with 
larger samples and in other areas throughout the training 
pipelines to confirm the trends encountered in this study. 
Although the personality variables were not included in the 
logistic analysis one might expect the addition of these 
variables to improve the predictive ability as they did in 
the linear model. 

Further analysis needs to be done with a pass/DOR and 
a pass/attrite criteria in addition to the pass/fail cri- 
teria investigated in this study. If the findings of this 
Paper are an indication of potential results and if the 
reported technique were applied to other stages of the 
meaining program, it could result in significant improve- 
ment in the prediction of student performance. Ultimately, 
the contribution of such techniques could result ina large 


Savings in naval training programs. 
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